(19) 



J 




(12) 



(43) Date of publication: 

01.12.1d99 Bulletin 1999/48 

(21) Application number: 99201535.4 

(22) Date of filing: 15.05.1999 



Europaisches Patentamt 
European Patent Office 
Off Ice europeen des brevets (11) 0 961 482 A2 

EUROPEAN PATENT APPLICATION 

(51) IntCI. 6 : H04N1/60 



(84) Designated Contracting States: 

AT BE CH CY DE DK ES H FR GB GR IE IT U LU 
MCNLPTSE 

Designated Extension States: 
ALLTLVMKROSI 

(30) Priority: 28.05.1998 US 85788 
28.05.1998 US 86044 
28.05.1998 US 86146 
28.05.1998 US 86333 
25.06.1998 US 104548 

(71) Applicant: EASTMAN KODAK COMPANY 
Rochester, New York 14650 (US) 

(72) Inventors: 

• Buhr, John Douglas, 
c7o Eastman Kodak Company 
Rochester, New York 14650-2201 (US) 



• Goodwin, Robert Melvin, 

c/o Eastman Kodak Company 
Rochester, New York 14650-2201 (US) 

• Koeng, Frederick R., 

c/o Eastman Kodak Company 
Rochester, New York 14650-2201 (US) 

• Rivera, Jose Esteban, 

c/o Eastman Kodak Company 
Rochester, New York 14650-2201 (US) 

• BrocWer, Frank Richard, 
Eastman Kodak Company 
Rochester, New York 14650-2201 (US) 

• Sowinskl, Allan Francis, 

c/o Eastman Kodak Company 
Rochester, New York 14650-2201 (US) 

(74) Representative: 

Lewandowsky, Klaus, Dipl.-lng. et al 
Kodak Aktiengesellschaft, 
Patentabteilung 
70323 Stuttgart (DE) 



CM 
< 

CO 



CO 
CD 



(54) Digital photof inishing system including digital Image processing of alternative capture color 
photographic media 

(57) A method of digital photofinishing comprising ^ 

the steps of: producing a digital color image in printing 
densities of a color image captured on alternative cap- 
ture photographic media; first mapping the printing den- 
sities of the alternative capture photographic media to 
the printing densities that would have been obtained for 
reference color photographic media; processing the 
mapped digital color image with a scene balance algo- 
rithm to produce a processed digital color image; sec- 
ond mapping the processed digital color image through 
a hard copy media characteristic curve to produce a 
mapped digital color image mapped to print densities of 
the hard copy media; sharpening the mapped digital 
color image with a sharpening algorithm optimized to 
avoid unacceptable artifacts; and digitally printing the 
sharpened digital color image onto hard copy media. 
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Description 

FIELD OF THE INVENTION 

s [0001 ] This invention relates in general to digital photof inishing systems and more particularly to a digital photo* inish- 
ing system selectively including film under exposure gamma, scene balance, contrast normalization, and sharpening 
digital image processing for alternative capture color photographic media. 

BACKGROUND OF THE INVENTION 

10 

[0002] Several problem areas need to be addressed when making color negative paper prints from color negative film 
images. The object of the process is to make a pleasing print from the film image. The first problem is to find the level 
of exposure necessary in a projection printer system to produce that pleasing print In the simplest implementation of a 
process, one projects the color negative film image onto a photosensitive paper image receiver, processes the paper, 

is and then repeats the process until a pleasing print has been obtained. In automated photo-finishing operations, a film 
scanner reads densities from the negative and passes the information to a computer algorithm that computes the 
appropriate exposure values so that a pleasing print can be obtained. At this point, the conventional photographic print- 
ing process ends. That is, if there are any remaining problems in a photographic image, no other simple processes are 
available to reduce the severity of the problem. Problems such as film under-exposure or over-exposure, inappropriate 

20 gamma for a particular scene, poor quality camera or printer lenses, low or high activity of film or paper processes, poor 
scene balance, and poor sharpness in the final image remain that we would like to correct or modify. 
[0003] Methods and systems have been described for more than 10 years that are devoted to producing pictorial 
images oh various media and devices from scenes captured on photographic film, via scanning to produce a digital 
image, image processing, and output rendering, Examples include the following. 

25 : ■ : . - •.>,■.• ^ y . 

• Journal of Imaging Technology, Vol. 14, Number 3. June 1988, Fifth et al. describe systems that capture scenes 
on film, scan film to produce a digital image, digitally process the image, and output via a laser AgX printer. 

U.S. Patent 4,500,919, Schreiber discloses an image reproduction system that scans an image captured on film, 
displays the image on a video monitor, enables image processing, and finally output to an inked hardcopy. 
30 • U.S. Patent 4,979,032 (Dec. 18, 1990, filing date: Dec. 27, 1988), Alessi et al. describe an apparatus, including a 
film scanner, a video monitor, image processing, and output to produce various output visually matched to the 
image displayed on the monitor. 

• U.S. Patent 5,267,030. issued November 30, 1993, inventors Giorgianni et. al. describe method and means to 
transform images captured on fflm, via digitization on a film scanner, to a color metric or other space, with output 

35 onto a variety of media and devices. This document describes the improvements offered by digital image process- 
ing, including aesthetically pleasing modifications to the tone and color reproduction as well as sharpening. 
U.S. Patent 5.300,381, issued April 5, 1994, inventors Buhr et. al. describe a pictorial imaging system that consists 
of capture on photographic film, film scanning to produce a digital image, image processing, and digital output 
U.S. Patent 5.579,132. issued November 26, 1996, inventor Takahashi describes an image processing system 

40 devoted to storing or producing images that have "substantially the same color" or additional "aesthetic color cor- 
rection" versus the original scene, based on a variety of image processing transformations of the digitized image. 
U.S. Patent 5,608,542, issued March 4, 1997, inventors Krahe et al. describe a system that produces index prints 
based on scanning a film frame, image processing, and rendering. 

• U.S. Patent 4.945.406, issued July 31, 1990, inventor Cok. describes a system for achieving automatic color bal- 
45 ancing of color images by transferring color pixel values from log exposure RGB color values into printing density 

values and generating color correction offset values utilizing a printing density based color correction method. 

[0004] The KODAK 35mm/24mm color negative film format Index Printer/sold by Kodak, produces an index print (a 
matrix of small imagettes) reproduced from individual film image frames. The index print is produced by the photof in- 
50 isher when the original print order is processed and is supplied to the customer as a convenient means of identifying 
image frames on the film (see: U.S. Patent 5.608,542, above). The Kodak Index Printer uses image processing on the 
miniature images including: 

• digital image in film RGB printing density 

55 • applying a scene balance algorithm to balance the digital film printing density image 

mapping the color negative digital image onto a color paper (EDGE-type) characteristic curve 
digital sharpening 

rendering using a CRT printer onto photographic paper 
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[0005] In the Index Printer, the above image processing: (1) is not applied to full frame images in a digital color printer; 
and (2) is not applied to high resolution images in a digital color printer, only low resolution images. 
[0006] U.S. Patent 5,134,573, issued July 28. 1992, inventor Goodwin, discloses a method for increasing the range 
of values representing a color image which exhibit a linear response. The toe and/or shoulder regions of the film's three 
5 density vs. log exposure tables are straightened using look up tables. 

[0007] U.S. Patent 5.012.333, issued April 30. 1991 , inventors Lee et ah, discloses a dynamic range adjustment sys- 
tem for printing digital images based on visual photoreceptor adaption and human visual contrast sensitivity. The sys- 
tem adjusts the contrast of the low frequency component only of the image, preserving the high frequency component 
in its contrast. 

w [0008] All of these articles or patents describe, in one form or another, processes for obtaining more pleasing prints 
from a fflm image capture than the conventional optical process. There is thus a need for a solution to these problems, 
which can be incorporated into a digital photof inishing system. 

[0009] While it is straight-forward to produce high-quality images from high-quality media capture through standard 
optical-printing photo-finishing on high-quality color photographic paper using high-quality chemical processing and 
is printing equipment that is property run, it would be beneficial to produce high-quality images from capture media that 
would not produce such results using the same optical printing photo-finishing path. Such light-sensitive media might 
be lower in cost or unsuitable for optical printing, and use conventional chemical processing, alternate chemical 
processing, or other non-traditional image development processing, such as that used in instanlphotography or applied 
heat without liquids. 
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SUMMARY OF THE INVENTION 



1001 0] According to the present invention, there is provided a solution to the problems of the prior art 

[001 1 ] According to a feature of the present invention, there is provided a method of digital photof inishing comprising 

25 the steps of: producing a digital color image in printing or other densities of a color image captured on alternative cap- 
ture photographic media; first mapping the printing or other densities of the alternative capture photographic mecfia to 
the printing densities that would have been obtained tor reference color photographic media; processing the mapped 
digital color image with a scene balance algorithm to produce a processed digital color image; second mapping the 
processed digital color Image through a hard copy mecfia characteristic curve to produce a mapped digital color image 

so mapped to print densities of the hard copy media; sharpening the mapped digital color image with a sharpening algo- 
rithm optimized to avoid unacceptable artifacts; and digitally printing the sharpened digital color image onto hard copy 

media. V . 

[0012] According to another feature of the present invention, there is provided a method of digital photofinishing com- 
prising the steps of: producing a digital color negative image in optical or other printing densities of a color image cap- 

35 tured on a color negative photographic element which is optimized for producing a color image suited for conversion to 
an electronic form and subsequent reconversion into a viewable form; mapping the printing densities of the digital color 
negative image to the printing densities that would have been obtained for the reference color negative photographic 
element; processing the mapped digital color negative image with an underexposure scene balance algorithm; map- 
ping the processed digital color negative image through a hard copy media characteristic curve to produce a digital 

40 color positive image; sharpening the mapped digital color positive image with a sharpening algorithm optimized to avoid 
unacceptable artifacts; and digitally printing the sharpened digital color image onto hard copy media. 

ADVANTAGEOUS EFFECT OF THE INVENTION 

45 [0013] The invention has the following advantages. 

1 A Digital photofinishing system is provided that produces high quality digital photographic reflection prints from 
alternative color negative film images that match those that would have been obtained from a reference film at high 

print rates. ta . . 

so 2. Sharpness that is difficult to correct in conventional optical photofinishing systems is corrected by digital image 
processing in a digital photofinisher. 

3. Prints produced by the digital photofinishing system of the invention were preferred over prints produced by opti- 
cal photof inishing systems. 

4. Prints produced by the digital photofinishing system that have improved overall print contrast from color fflm neg- 
55 atives that are under-exposed. .. . * 

5. Prints produced by the digital photofinishing system that have a preferred image contrast position relative to a 
traditional optical print 

6. The contrast normalization algorithm improves quality of low contrast scenes by increasing image contrast and 
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of high contrast scenes by decreasing image contrast. 

7. Improves quality of prints produced from low activity film and/or paper chemical processes by increasing the print 
contrast. 

8. Improves quality of prints produced from high activity film and/or paper chemical processes by decreasing the 
5 print contrast 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] 

70 

Fig. 1 is a block diagram of a digital photofinishing system incorporating the present invention. 

Fig. 2 is a flow diagram of a preferred method of the present invention. 

Fig. 3 is a graphical view useful in explaining aspects of the present invention. 

is DEFINITION OF TERMS 

[001 5] The term "reference color photographic media- is used to indicate conventional color negative film developed 
through conventional color negative film processing which is used to produce a color image on conventional color pho- 
tographic paper using optical printing photofinishing. 
20 [001 6] The term "alternative capture color photographic media" is used to indicate one of the following. 

1 . A color negative or reversal photographic element for producing a color image suited for conversion to an elec- 
tronic form and subsequent reconversion into a viewable form comprised of a support and, coated on the support, 
a plurality of hydrophilic colloid layers, including radiation-sensitive silver halide emulsion layers, forming layer units 

25 for separately recording blue, green, and red exposures, each of the layer units containing dye image-forming cou- 
pler chosen to produce image dye having an absorption half-peak bandwidth lying in a different spectral region in 
each layer unit, wherein the layer units are substantially free of colored masking coupler, the layer units each exhfoit 
. a dye image gamma of less than 1.5, the element exhibits an exposure latitude of at least 2.7 log E, where E is 
exposure measured in lux-seconds, and wherein the gamma ratio for each of the blue and red color recording units 

30 is between 0.8 and 1 .2. 

2. A color photothermographic element that is thermally processed. Specific examples of multicolor photothermo- 
graphic elements are described by Ishikawa et al. in European Patent Application EP 0726201 A1. 

3. A color photographic element processed by instant processing techniques. 

35 DETAILED DESCRIPTION OF THE INVENTION 

[0017] Referring to Fig. 1, there is shown a block diagram of a digital photofinishing system 10 incorporating the 
present invention. As shown, system 10 includes a digital scanner 12 for scanning color photographic media 14 to pro- 
duce a digital color image of a color image frame 16 on color media 14. Color media 14 is a negative f9m. Image data 
40 manager 1 8 processes the digital image to optimize the image for printing the processed image by printer 20 on color 
hard copy media 22. Color hard copy media can be any high quality reflection or transmissive media, such as silver hal- 
ide color paper, and media used in ink jet. thermal, electrophotographic printing processes. The operation of scanner 
12 and printer 20 are described in greater detail below. 

[0018] Image data manager (IDM) 18 processes the digital color image from scanner 12. 1 DM 18 is preferably a digital 
45 computer having user input 24 (keyboard, mouse) and computer readable storage media input 26. Computer readable 
storage media may comprise, for example, magnetic storage media, such as a magnetic floppy disc or magnetic tape; 
optical storage media, such as optical disc, optical tape or machine readable bar code; solid state electronic storage 
devices, such as read only memory (ROM) or random access memory (RAM); or any other physical device or medium 
employed to store a computer program. The digital image processing techniques described below can be stored on 
so readable storage media Alternatively, some or all of the techniques may be incorporated into programmable gate 
arrays or other hard electronic devices. 

Scanner 

55 [001 9] The scanner 1 2 for the production of digitally processed prints scans a 35 mm full frame image at a minimum 
resolution of mx n pixels. It would be preferred that the scanner produce a higher image resolution of, e.g., 2m x 2n 
pixels so that "panoramic" images or enlargements can be printed with sufficient resolution without interpolation. The 
higher resolution is also preferred for the preparation of 5R prints. All magnifications higher than 5R will require higher 
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resolution scans. 

[0020] It is preferable that the scanner deliver the digitized data to the image processing algorithm as "printing den- 
sity." A scanner that measures printing density has red. green, and blue effective spectral response that matches that 
of photographic paper in an optical printer. Photographic films intended for optical printing are designed based on the 
expectation that the captured information in the film will be read by this type of red. green and blue spectral response 
characteristic. 

[0021] Even though the scanner is not considered part of the digital image processing path, some manipulations of 
the data may be required to deliver "printing density" to the processing algorithm. Two key steps are converting scanner 
densities to calibrated scanner densities, and converting the calibrated scanner densities to printing densities. Matrix 
operations may be required to perform these conversions. 

[0022] The first step in the process is to convert the raw scanner numbers to calibrated scanner densities. If a matrix 
operation is used, an appropriate matrix correction model is shown below. 
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T^nx is raw scanner number and 75^ is corrected scanner density. 

[0023] The next process in the scanner converts calibrated scanner densities to calibrated printing densities. The 
process is implemented again with a matrix model that in this case can be up to a 3 x 10 matrix rnultiplication. An exam- 
ple is shown below. 
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The output of the matrix multiplication is calibrated printing density. A* is calibrated scanner density, and 75^ is cali- 
brated printing density. Either or both of these steps can be implemented with a 3D look-up-table. 
[0024] If the scanner does not measure -printing densities" directly for the alternate capture media, the "scanner den- 
sities" produced by the scanner can be transformed to reference printing densities for the alternate capture film as the 
first step in the image processing. Alternatively, the scanner densities for the alternate capture media may be passed 
to the Image Data Manager if the image processing parameters can accommodate this input type. These pathways per- 
mits using specially designed alternate capture media and scanners that result in identical images to those that would 
be obtained with the reference media and "printing density" scanners. 

[0025] Fig. 2 is a flow diagram of a general image processing system for digital photofinishing incorporating the 
method of the invention. The diagram is divided into several sections: digital image acquisition (box 30). the analytical 
section (box 40) performs analytical evaluations to prepare shift values for color and density balance, and tone lookup 
table preparation for control of final print contrast. This information is then passed into the processor section (box 50) 
of the model to prepare the digitized film image for printing section (box 60). 

[0026] In the image acquisition section, an image on photographic media (negative film) (box 32) is scanned (by scan- 
ner^) to produce a full resolution digital image (box 34). 
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Conversion to Reference Media Printing Densities 

[0027] The first step in the image processing is to convert the densities produced by the scanner from the scanned 
alternate capture photographic media to the printing densities that would have been produced from the reference color 
5 photographic media (box 36) . This is accomplished by applying a conversion matrix or 3D look-up table to the pixel den- 
sities in the captured image. 

[0028] The conversion matrix or 3D look-up table can be created by subjecting the alternate capture media and the 
reference media to the same set of exposures. The exposures are selected to sample the exposure range that the 
media and reference media would experience in their red. green, and blue response channels when used for image 

io capture in the marketplace. To provide an accurate density conversion, it is recommended that at least 70 different 
exposure values be used to create the densities for the films that will be used to calculate the matrix or 3D look-up table, 
using regression techniques or look-up table populating techniques (for example, US. Patent 4,941,039). After appro- 
priate chemical processing of the reference media, and appropriate chemical or other processing of the alternative cap- 
ture media to be used, the densities for the alternate capture media are measured using the spectral responsivities that 

is represent the densities that will be transmitted to the Image Data Manager 18, and the densities for the reference media 
are measured in reference printing densities. A matrix or 3D look-up table is calculated from this data that maps the 
alternate capture media densities to the printing densities for the reference media. 

[0029] The preceding paragraph describes the preferred method of converting the densities from a specific alternate 
capture media to a specific reference media. For convenience, it may be necessary to map several alternate capture 

20 media densities to one reference media. In this case, approximate conversion matrices and 3D look-up tables may also 
be used to effect the density conversion from alternate capture media to reference capture media, with somewhat less 
resultant print quality. These parameters may be obtained for similar alternate capture or reference capture materials. 
[0030] A more preferred method for image pixel density conversion from alternate capture media to reference capture 
media incorporates the application of red, green, and blue channel 1 D look-up tables prior to and/or after the application 

25 of the matrix or 3D look-up table. The 1 D look-up tables can be used to correct gross differences in the characteristic 
curves for the alternate and reference capture media. 

[0031] In principle, the conversion from alternate media capture densities to reference media printing densities could 
be made at different points in the image processing change. However, the preferred location is prior to the Analysis step. 

30 Analytical Section 

[0032] The image process begins with the digitized film image. The image, with a minimum resolution ofmxn pixels, 
may be sampled down to a m* x n* pixel image tat is analyzed by a scene balance algorithm (SBA), and a contrast nor- 
malization algorithm. This information is passed to the processor section of the algorithm so that the full resolution 

35 image, or any other subsampfed jmage. can be processed by an equivalent process. 

[0033] The analysis phase determines a set of shift values, to be added to the digitized pixel values, that are neces- 
sary to assure that the final print densities will be appropriate. The scene balance algorithm determines a set of densi- 
ties that represent a form of "average densities" that are compared to a known set that produces a pleasing print. These 
numbers force the digitized image to print to the proper print density and color balance. The average densities are sub- 

40 tract ed from the assumed gray density point of the paper look-up table to give shift values that will modify the image to 
produce a pleasing print for density and color balance. Next, the sub-sampled image is evaluated and corrected for 
under exposure (box 48). 

[0034]* The image is shifted to a new D min position so that the correction process produces no negative density values. 
A look-up table is applied to the sub-sampled image such that low film gamma information that is contained in the toe 
45 of the film sensitometric curve is changed in density to increase the gamma The image is then shifted back to the orig- 
inal D m in position (the two "shift" operations complement one another). The technique disclosed in US. Patent 
5.134.573, issued July 28. 1992. inventor Goodwin, can be used. The shift values are then applied to the full resolution 
digital color image (box 46). 

[0035] Finally, the sub-sampled image is analyzed using the contrast normalization algorithm (box 46). The algorithm 
so produces a look-up table that is used to modify the printing density values of the image in a way that produces final print 
images with a more pleasing contrast The look-up table does the slope correction in 1-space" luminance, the metric 
used by the scene balance algorithm. The tone scale modification is a two step process; first is the rotation to 1-space" 
followed by the actual algorithm that produces the look-up table. (See: U.S. Patent 5,012.333. issued April 30. 1991, 
inventors Lee et al.) 

55 [0036] The analytical section produces two items that are sent to the processor section of the image processing algo- 
rithm; the computed shift values and the image dependent tone scale look-up table. 

[0037] The look-up table used by the algorithm may be a universal table for all media types and conditions. Or it may 
be a function of media type, lab preference, or customer preference. If it is a function of media type, it may be accessed 
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based on the DX code on the media. 

[0038] The look-up table that is applied to correct the gamma of the capture media in the under-exposure region may 
be obtained from a number of different sources. The look-up table may be encoded optically or magnetically on the cap- 
ture media. The look-up table may be calculated by the software from reference exposure patches on the capture 

5 media. Media reference exposure patches are described in U.S. Patent 5,649.260. The look-up table or look-up table 
precursor data may be encoded on optical, magnetic, or other media that accompany the capture media. The look-up 
table may be selected or supplied, directly or indirectly, by the customer or processing lab. The look-up table may be 
accessed from a software embodiment database, based on the media type, lab preference, or customer preference. 
The look-up table may also be accessed via the intranet from an available repository, based on the media type, lab pref- 

w erence. or customer preference. 

[0039] U.S. Patent 5.1 34.573 teaches the calculation of correction look-up table with a limiting gamma enhancement 
value to avoid unwanted noise introduction. We have found that it is preferable in some cases to calculate the correction 
look-up table as a fraction, such as 0.5, of the gamma adjustment factor that is required to fully correct the media toe 
gamma to match that of the media in a normally exposed region. 

is [0040] In the absence of an exposure-density sensitometry present on the specific media providing the image that 
are being processed, the look-up table may be derived from different media response approximates, such as media aim 
sensitometry. In general, in the absence of customer preference, media-type specific look-up tables provide higher 
quality images, and the most preferred are the media-type population averages for the processing lab. 

20 Scene Balance Mapping 

[0041 ] The process of operating a two stage film/media printing system has as its most imposing task that of finding 
a density value on the fflm exposure and mapping the densities on that negative to the media so that the best overall 
density and color balance are obtained. The process is best illustrated by tying together a series of reference points 

25 showing the connections from a scene object to the photographic reproduction of the object 

[0042] Fig. 3. below, illustrates the concept of density tie points in our analysis of printing process. This process ties 
an initial target usually a uniform gray card, to the photographic reproduction of that target Test points are established 
for the initial exposure of the target object as an expected reference film density from a film reference exposure for the 
test object. The quadrant labeled "Printer merely reflects the film reference density to the log exposure axis of the 

30 media The test target will be assigned a density to be achieved for the reproduction of that object, or a density at the 
paper balance point This point is characterized as the media reference exposure value and a media reference density 
value. 

[0043] The objective of the scene balance process is to first determine the film density value for the film reference 
exposure and to determine the difference between this film density value and the media reference exposure value. The 
35 difference, or A. is added to the film reference density. This process assures that the quadrant labeled "Print Through" 
will yield the appropriate print density in the final reproduction of the scene. 

[0044] Real photographic opportunities, or images, usually do not contain test objects that can be mapped in a formal 
process like that just described. Scene balance algorithms are designed to perform the task of estimating the reference 
film density, as if a gray card had been included in the scene. Once an estimate of the film reference density has been 
40 made the process is duplicated just as described above. The examples show only one color record. Color films contain 
three records to capture the red, green, and blue information from a scene. Thus, the scene balance algonthms must 
perform two tasks. First estimate the overall density of the film image to that the best neutral density is obtained in the 
final print or print through quadrant of the scene. Then the balance between the red. green, and blue exposure must 
be estimated. 



45 



Image Processor Section (box 50, Fig . 2) 

[0045] The first step in the proposed image processing algorithm is deep under correction (box 52). A shift in the print- 
ing density data is performed so that a single column table can be used to shift the red. green, and blue pixel densities. 

so In this instance, the red. green, and blue pixel printing density values are adjusted so that the film minimum densities 
values (D^ are all 0.5. All of the digitized data then is modified by a table look-up process such that image densities 
that occur near or in the film sensitometric toe region are actually reduced to increase the image information gamma. 
The table consists of a single column of numbers. The column represents the substitution values for the red, green and 
blue pixel values. In the final step of the gamma correction process, a shift is applied that restores the density values to 

55 the previous unformalized D min values. _ 
[0046] The scene balance shift values are applied to the printing density values (box 54). These values represent the 
shift (add to the red. green, and blue pixel values) necessary to achieve a print that has the correct color balance and 
density. 
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[0047] Next, the tone scale look-up table from the analysis process is applied to the image (box 56). The image must 
first be rotated to "t-space" since the best tone scale results (image quality) are achieved when done on the luminance 
information. The matrix tjspace.mat is used in this process. 



tjspace.mat 



1/3 1/3 1/3 
1/4 1/2 -1/4 
1/2 0 1/2 



t_spacejnv.ma\ 



1 -2/3 -1 
1 4/3 0 
1 -2/3 1 



[0046] After the tone scale look-up table has been applied to the image, the image data is rotated back to printing 
density space using the matrix t_space__inv.mat. 



Printer Section (box 60) 

is [0049] The next step in the process is to map the balanced image through a hard copy media (color photographic 
paper) characteristic curve (box 62). The printing density values of the balanced image are mapped to the appropriate 
print density values for negative photographic print paper. The finished process produces an image that is color and 
density balanced, and in a print density metric. The photographic paper curve is balanced. 

20 Unsharp Masking Process 



[0050] The final step prior to actually printing the image is the sharpening process (box 64). An unsharp masking algo- 
rithm is applied to every image just prior to printing. The unsharp masking equation is as follows. 

D c [x) = D{x) + p(D(x) - Jq>«)D(x - * )d?) 

In this equation, DJx) is the "sharpened" density at position x, Dfx) is the starting density at position x, the recom- 
mended value of p is 2.5, and the integral values at each pixel position are computed by convolving the image with the 
kernel, below. 

"01510" 
1 21 38 21 1 
5 38 60 38 5 
1 21 38 21 1 
0 15 1 0 
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40 

The red, green, and blue images are ail sharpened to the same level. 

[0051] The recommended value for p was established by adjusting the value upwards until pictures, when printed, 
began to appear with unacceptable levels of digital artifacts. These artifacts appeared as ringing, or halos. on edges 
yielding images that appear unnatural. 

45 [0052] This value of beta is then applied to a square wave target to measure the modulation transfer function for the 
final processed image. The test to establish the full system MTF response is as follows. First, a target is photographed 
using a color negative film. The original target has a square wave pattern of approximately 40% modulation. The spatial 
frequency response values for each frequency of square wave pattern is 1 00% through all of the system visible frequen- 
cies. The film image was scanned on the digital scanner to produce a 1 024 x 1 536 pixel digital image for subsequent 

so processing. This image was processed through our SBA plus sharpening path and printed. The spatial frequency 
response of the final print was measured with a high resolution microdensitometer, and the data analyzed using a har- 
monic analysis process. Table 1 lists the red, green, and blue response measured in this test (average of four samples) 
and represents the maximum MTF before significant artifact production occurs. 

[0053] The MTF curve measured using this process represents the maximum spatial frequency of any digital process- 
55 ing system for Digital Photof inishing. This as the final print image is a combination of camera lens, film, scanner, algo- 
rithm, print engine, and print media. Any combination of these elements that yields and MTF curve of this result, or any 
result below the values listed in Table 1 . will be considered as part of this invention. The set of parameters considered 
for this system, including the sharpening algorithm, are the maximum level of boost before going into a condition of 
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qversharpening. Values of beta lower than that specified in the report are considered within the scope of this invention 
because these values also deliver prints that meet our printing requirements for making digital prints. If one of the sys- 
tem components is changed, then the beta value will be changed to assure that any final image produced by this digital 
path will achieve the upper limit MTF curve. 



Table 1 



^ Maximum MTF Values i 


! Freq 


Red 


Green 


Blue 


0.0 


1.0000 


1.0000 


1.0000 


0.5 


0.9813 


1.0500 


1.0785 


1.0 


0.9680 


1.1180 


1.1423 


1.5 


0.8735 


1.0840 


1.0948 


2.0 


0.7118 


0.924 


0.9298 


2.5 


0.5263 


0.7170 


0.7170 


3.0 


0.3523 


0.5380 


0.5238 3 


3.5 


0.2225 


0.3970 


0.3725 


4.0 


0.1510 


0.2910 


0.2688 j 


4.5 


0.1150 


0.2140 


0:2023 


5.0 


0.0893 


0.1610 


0.1593 


| 5.5 


0.0690 


0.1250 


0.1308 


! 6.0 


0.0530 


0.1000 


0.1095 


6.5 


0.0410 


0.0840 


0.0945 


Notes: 

(1 ) The column labeled "Freq" is spatial frequency in cycles/mm on a 4R reflection print and the columns 
labeled as colors are the response values for that color at each spatial frequency. 

(2) The MTF values are given fora4 m x 6 m print, 250 dots per inch, and 1024 x 1536 pixels. 



{0054] Psycho-physical experiments were conducted to compare these digital path prints to a convention optical print- 
ing path. The optically printed images were prepared using a CLAS 35 optical printer running in the full order printing 
mode, thus emulating the SBA operating in our digital path. The scene balance algorithm parameters used in the digital 
40 and optical paths were the same so that similar prints could be prepared. Pairs of prints, digital and optical, were shown 
to a panel of three judges who were asked to choose the best print from the pair. In 75% of the pairs, the digital print 
was selected, citing sharpness as the reason. The remaining 25% were the optical prints selected because of grain 
build-up in the digital prints. 

46 Printer 

[0055] At this point in the process, the printing densities should be fully balanced and corrected. This image informa- 
tion can be printed through a simple printing density to print density look-up table. 

[0056] In the simplest case (printing density to print density), the printing density values are mapped to the appropri- 
so ate print density values for a positive photographic paper. The finished process produces an image that is color and 
density balanced, and in a print density metric. We find the most preferred mapping from the balanced digital color neg- 
ative image onto the characteristic curve of the aim AgX paper results from mapping reference RGB printing densities 
representing an achromatic middle gray onto achromatic RGB paper densities. These RGB paper densities are a func- 
tion of the print material image dye spectra. 
55 10057] The final step prior to actually printing the image is the sharpening process which has been described previ- 
ously. 

D c {x) = D(x) + p(D x - J<p(?)0(x- «)d?) 
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[0058] At this stage in the process, the encoded data is sent to a printing device that renders, or digitally prints, the 
information on hard copy media (box 66). A calibration process must be operating on this device such that the code val- 
ues presented to the printer will yield the expected print densities. 

[0059] Hard copy media includes media optimized for the print technology used, i.e., laser or CRT photographic print- 
5 ers, ink jet printer, thermal printer, electrophotographic printer, etc. 

Printer Calibration 

[0060] Printer calibration will be done as part of the image processing system maintenance such that test patch den- 
10 sity differences between measured and expected densities of less than 0.01 are obtained. The simplest embodiment 
only requires a neutral scale calibration. In more complex applications, a color calibration may be necessary. 
[0061 ] A series of uniform patches (at least 1 8) spanning the full range of printer code values are printed through an 
initial calibration LUT. This initial LUT must cover all those D/A count values that produce density on the print. The patch 
densities on the print are measured. With the initial LUT, the list of code values, respective densities of those patches. 
is and the aim curve, a new calibration LUT can be calculated which should modify printing behavior according to the cal- 
ibration aim. 

[0062] It will be appreciated that image sharpening can be effected at other points in the image processing chain. It 
will also be appreciated that the goal of the image processing described herein is to produce images via digital printing 
that are similar to, or better than, images produced by optically printing negative film images. This can be done in a 

20 straight forward manner as described herein when using digital hard copy media having similar image dye spectra to 
the image dye spectra of the hard copy media (silver halide color paper) used in optical printing. 
[0063] In general, scene contrast modification algorithms contain adjustable parameters that provide a mechanism to 
improve the algorithm results for specific scenes, for specific capture media, and/or for specific customers. These 
adjustable parameters may be fixed for a specific software version emboCfiment of the algorithm. Or they may be 

26 obtained by the software embodiment of the algorithm from different sources. They may be encoded on the capture 
media optically or magnetically. They may be encoded on optical, magnetic, or other media that accompany the capture 
media. They may be selected or supplied, directly or indirectly, by the customer or processing lab. They may be 
accessed from a software embodiment database, based on the f flm type, lab preference, or customer preference. They 
may also be accessed via the intranet from an available repository, based on the film type, lab preference, or customer 

so preference. 

Claims 

1. A method of digital photof inishing comprising the steps of 

35 

producing a digital color image in printing or other densities of a color image captured on alternative capture 
photographic media; 

first mapping said printing or other densities of said alternative capture photographic media to the printing den- 
sities that would have been obtained for reference color photographic media; 
40 processing said mapped digital color image with a scene balance algorithm to produce a processed digital 

' color image; 

second mapping said processed digital color image through a hard copy media characteristic curve to produce 
a mapped digital color image mapped to print densities of said hard copy media; 

sharpening said mapped digital color image with a sharpening algorithm optimized to avoid unacceptable arti- 
45 facts; and 

digitally printing said sharpened digital color image onto hard copy media 

2. The method of claim 1 wherein said producing step produces a digital image in printing densities of an image frame 
captured on traditionally chemically processed color negative or reversal film of nonconventionally chemically proc- 

50 essed color negative or reversal film, thermally processed color photographic element, or instant processed color 
photographic element 

3. The method of claim 1 wherein said producing step is carried out using a digital color scanner. 

55 4. The method of claim 1 wherein said processing step processes said mapped digital color image with an underex- 
posure gamma correction in addition to said scene balance algorithm. 

5. The method of claim 1 wherein said processing step processes said mapped digital color image with a contrast nor- 
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malization algorithm in addition to said scene balance algorithm. 

6. The method of claim 1 wherein said processing step processes said mapped digital color image with an underex- 
posure gamma correction algorithm and a contrast normalization in addition to said scene balance algorithm. 

5 

7. The method of claim 6 wherein said processing step includes the steps of creating a subsampted digital image of 
said digital image, processing said subsampled digital image (1) with an underexposure gamma correction algo- 
rithm; (2) with a scene balance algorithm to produce density shift parameters which are applied to said full digital 
image to produce a scene balanced digital image; and (3) with a contrast normalization algorithm to produce a tone 

10 scale look up table (LUT) which is applied to said full digital color image. 

8. The method of claim 1 wherein in said second mapping step said hard copy media is photographic paper and said 
hard copy media characteristic curve is photographic paper characteristic curve, and wherein in said printing step 
said hard copy media is photographic paper. 

15 

9. A method of digital photof inishing comprising the steps of: 

producing a digital color negative image in printing or other densities of a color image captured on a color neg- 
ative photographic element which is optimized for producing a color image suited for conversion to an elec- 
20 tronic form and subsequent reconversion into a viewable form; . 

mapping said, printing densities of said digital color negative image to the printing densities that would have 
been obtained for reference color negative photographic element; 

processing said mapped digital color negative image with an underexposure scene balance algorithm; 
mapping said processed digital color negative image through a hard copy media characteristic curve to pro- 
26 duce a digital color positive image; 

sharpening said mapped digital color positive image with a sharpening algorithm optimized to avoid unaccept- 
able artifacts; and 

digitally printing said sharpened digital color image onto hard copy media 

30 1 0. The method of claim 9 wherein said processing step processes said mapped digital color image with one or both 
of an underexposure gamma correction algorithm and a contrast normalization algorithm in addition to said scene 
balance algorithm. 
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